Feature(LiteLLM): Wire LiteLLM Docker profile with application config overrides (provider and embedder) - #533
Conversation
There was a problem hiding this comment.
Code Review
This pull request introduces LiteLLM-specific configuration files (embedder.litellm.json and generator.litellm.json) and mounts them as overrides in docker-compose-litellm.yml. Feedback is provided to address two critical configuration issues: first, the num_ctx parameter should be removed from the litellm provider models in generator.litellm.json to prevent a runtime TypeError when calling the OpenAI-based client; second, the initialize_kwargs block in embedder.litellm.json should be removed to avoid passing literal placeholder strings when environment variables are unset, allowing the client to safely fall back to its native environment lookups.
Important
The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.
There was a problem hiding this comment.
Your trial has ended. Reactivate Greptile to resume code reviews.
There was a problem hiding this comment.
Your trial has ended. Reactivate Greptile to resume code reviews.
Summary
This PR is part of a 4-PR integration effort to add LiteLLM support to DeepWiki-Open while maintaining full backward compatibility.
PR Series
Summary (this PR)
This PR completes the deployment-layer integration for LiteLLM by wiring the Docker Compose setup to application-level provider and embedding configurations.
It ensures that when LiteLLM is enabled via Docker, the correct provider configuration and model registry are automatically applied.
🔧 Changes
Configuration Layer
generator.litellm.jsonwith full provider registry for:embedder.litellm.jsonfor LiteLLM-based embedding configurationDocker Integration
docker-compose-litellm.ymlgenerator.litellm.json → generator.jsonembedder.litellm.json → embedder.jsonProvider Alignment
🧠 Design Notes
🔄 Compatibility
This change is fully backward compatible:
🧪 Testing
Tested with:
📝 Notes for Reviewers
This PR focuses strictly on deployment + configuration wiring.
A documentation PR will follow to explain usage and setup flows.